Configuring Data Task

With input, processing and output operators, you can process the data source you added and output the processed result to whereever you need.

info

When no processing operator is involved in the task development, the input data is incrementally synchronized to the output data according to the set primary key of the data source.

1. Click a task to enter the modeling page.

No.	Section	Description
1	Task	Displays the current task name and version that is under developing.
2	Tool bar	Save: Directly save the task. Dispatch: Configure how to execute the data task, which can be cycled dispatch or triggered by upstream task or object model event. Task info: View and edit the task information. Variable: Add global variables that can be used during task development. info Format of Datetime type of data can be manually set.
3	Page tab	Switch the task view between Modeling (task developing) and Insight (task debugging).
4	Publish	Click to publish current task.
5	Operator	Provided operators that can be used to process input data by simple drag and drop.
6	Canvas	Task developing canvas.
7	Debug	Debugging details. You can click Download sample data to check the debugging log.

2. Drag an input operator under Data input based on the input data source.
3. Double-click the operator to configure its data source.

info

Different input data sources require different configuration, and Relational data source is used as an example here. For details, see Task Node Description.

1. Under Input selection, select the input data source type and name.
2. Select whether to directly input tables or use advanced SQL statements to draw data from database.
3. Select data synchronization method.
   • Cycle full amount: Synchronize all data from the data table.
   • Cycle increment: Select fields from the data table to synchronize.
4. Configure the output field, and you can set the sort order of each field, or add filters to the output fields.
5. Click Mapping config, select fields you want to be mapped as input data.
   tip

   • Select fields and then click Export to directly map all fields.
   • Click New to add new fields to receive the original fields.
   • Click the mapped fields to change their name, description and data type.

   

6. Click to save the current step.

4. Drag a data processing operator, connect to the input data operator, and then start configuring processing details.
   info

   Different types of data processing operator requires different configuration, and Data filtering is used as an example here. For details, see Task Node Description.

1. Double-click the data filering operator, and then select fields that you want to add filters to.
2. Select Filter condition.
3. Select Value type. Variable are the global variables you set.
4. Set the field value to be filtered.
5. Click to save the current step.

5. Drag a data output operator, connect to the data processing operator, and then start configuring output data details.

1. Double-click the data output operator, and then select a data source that you want to output data to.
   info

   • Different data output operators require different configuration, and Relational data source is used as an example here. For details, see Task Node Description.
   • For Relational data source, Paradox database cannot be the output destination.
2. Click Mapping config.
3. Map the filtered field to the output data source fields.

   

4. Click to save the current step.

6. Click Debug at the bottom, and the Insight results is automatically displayed when the task is executed successfully.

tip

On Insight page, you can click the input and output data operator to see the data change.